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A Method and System for Voice Messaging 

FIELD OF THE INVENTION 

The present invention relates to management of elec- 
tronic mail. 

BACKGROUND OF THE INVENTION 

Electronic mail, or e-mail, is fast becoming a dominant 
mode of communication. In its primitive form, e-mail is managed 
by two kinds of computer software: namely, e-mail server software 
(referred to simply as "e-mail servers") and e-mail client soft- 
ware (referred to simply as "e-mail clients"). E-mail .servers 
reside on centrally accessed computers (referred to as "server 
computers"), and manage incoming and outgoing e-mail for remote 
users who are authorized to use such server computers. E-mail 
servers maintain separate mail accounts for each authorized user, 
into which incoming mail is stored. E-mail clients reside on 
remote computers (referred to as "client computers") and manage 
incoming and outgoing mail for designated users. E-mail clients 
are responsible for downloading arriving mail items from the 
server computer at which they are located. E-mail clients are 
also responsible for transmitting outgoing mail from a remote 
Client computer to a server computer. Examples of popular e-mail 
clients for personal computers are EUDORA R , INTERNET EXPLORER R 
and NETSCAPE R . 

Standard e-mail uses a protocol named Simple Mail 
Transport Protocol (SMTP) for sending outgoing messages, and a 



protocol named Post: Office Protocol (POP) for receiving incoming 
messages. Other techniques and protocols for sending and receiv- 
ing e-mail may also be used, as appropriate. For example web 
based e-mail, using the HTTP protocol may be employed. 

For use over the Internet, Multipart Internet Mail 
Extension (MIME) extends the format of Internet mail to allow 
non-US-ASCII textual messages, non- textual messages, multipart 
message bodies and non-US- ASCI I information in message headers. 
Attachments to e-mail messages can be included within a multipart 
e-mail. One of the drawbacks with e-mail, however, is the need 
for a user to be connected to the Internet in order to receive or 
send his e-mail. 

Although Internet access is available in many homes and 
offices, and Internet stations are available in many public 
areas, being "un-wired" is still a concern for mobile users who 
are neither at home nor in their office. When on the road, a user 
often finds himself unable to access his e-mail, for a variety of 
reasons . 
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SUMMARY OF THE INVENTION 
This invention seeks to provide an apparatus and method 
for a voice communication system for the management of voice 
messaging. 

There is thus provided in accordance with a preferred 
embodiment of the present invention a voice communication system 
including a telephone network which includes a multiplicity of 
telephones interconnected by telephone network interconnections, 
a computer network having a multiplicity of nodes and enabling e- 
mail communication between the nodes, a multiplicity of voice 
response computers, each voice response computer being connected 
to a node of the computer network and being actuable by an input 
received from one of the multiplicity of telephones via the 
telephone network for communicating voice received via the one 
of the multiplicity of telephones via e-mail over the computer 
network . 

Further in accordance with a preferred embodiment of 
the present invention, the voice communication system also pro- 
vides buddy functionality whereby communications are sent to 
user-selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the voice communication system also 
provides buddy functionality whereby communications are sent to 
user-selected buddies via the computer network indicating that a 
user is communicating using a user's telephone via the telephone 
network with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
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buddy functionality whereby conununications are sent to user- 
selected buddies via the computer network indicating that a user 
has corrununicated voice via the telephone network and the computer 
network using a user's telephone and a user's voice response 
computer . 

Moreover in accordance with a preferred embodiment of 
the present invention the voice response computers are operative 
to convert Digital Tone Multi Frequency (DTMF) to a buddy commu- 

nication protocol. 

Additionally in accordance with a preferred embodiment 
Of the present invention the voice response computers communicate 
With a database. Preferably the database is an SQL database. 

Further in accordance with a preferred embodiment of 
the present invention the multiplicity of voice response comput- 
ers is actuated by the sender choosing an e-mail address of a 
recipient from a pre-defined directory. 

Furthermore the multiplicity of voice response comput- 
ers are actuated by the sender entering an e-mail address of a 
recipient via DTMF codes. Preferably the multiplicity of voice 
response computers are operative to store in a directory, e-mail 
addresses entered by a sender. 

Still further in accordance with a preferred embodiment 
of the present invention the multiplicity of voice response 
computers is actuated by the sender entering an e-mail address 
of a recipient via speech recognition by one of said multiplicity 
of voice response computers. 

There is also provided in accordance with a preferred 
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embodiraenl; of the present Invention a voice communication system 
including a telephone network including a multiplicity of tele- 
phones interconnected by telephone network interconnections, a 
computer network having a multiplicity of nodes and enabling e- 
mail communication between the nodes, a multiplicity of voice 
response computers, each voice response computer being connected 
to a node of the computer network and being actuable by an input 
received from one of the multiplicity of voice response computers 
via the computer network for receiving voice communicated via e- 
mail over the computer network and providing a voice output to a 
telephone via the telephone network. 

Further in accordance with a preferred embodiment of 
the present invention, the communication system also provides 
buddy functionality whereby communications are sent from user- 
selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent from user- 
selected buddies via the computer network indicating that a user 
is communicating using a user's telephone via the telephone 
network with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent from user- 
selected buddies via the computer network indicating that a user 
has communicated voice via the telephone network and the com- 
puter network using a user's telephone and a user's voice re- 
sponse computer. 
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Moreover in accordance with a preferred embodiment: of 
the present invention the voice response computers are capable 
of sensing the presence of a link to an audio file in e-mail 
received thereat • 

There is also provided in accordance with yet another 
preferred embodiment of the present invention a voice communica- 
tion system including a telephone network including a multiplici- 
ty of telephones interconnected by telephone network interconnec- 
tions, a computer network having a multiplicity of nodes and 
enabling e-mail communication between the nodes, a multiplicity 
of voice response computers, each voice response computer being 
connected to a node of the computer network and being actuable 
by an input received from one of the multiplicity of telephones 
via the telephone network for communicating voice received via 
said one of said multiplicity of telephones via e-mail over the 
computer network, each voice response computer also being actu- 
able by an input received from one of the multiplicity of voice 
response computers via the computer network for receiving voice 
communicated via e-mail over the computer network and providing 
a voice output to a telephone via the telephone network • 

Further in accordance with a preferred embodiment of 
the present invention, the communication system also provides 
buddy functionality whereby communications are sent to user- 
selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent to user- 
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selected buddies via the computer network indicating that a user 
is communicating using a user's telephone via the telephone 
network with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention, the communication system also pro- 
vides buddy functionality whereby communications are sent to 
user-selected buddies via the computer network indicating that a 
user has communicated voice via the telephone network and the 

computer network usina a user's 1-o^or^K^ « 

=>^iiy a user s telephone and a user's voice 

response computer. 

There is further provided in accordance with a pre- 
ferred embodiment of the present invention a voice communication 
system including a telephone network including a multiplicity of 
telephones interconnected by telephone network interconnections, 
a computer network having a multiplicity of nodes and enabling e- 
mail communication between the nodes, a multiplicity of voice 
response computers, each voice response computer being connected 
to a node of the computer network and being actuable by an input 
received from one of the multiplicity of telephones via the 
telephone network for communicating voice received via the one 
Of the multiplicity of telephones via a non-streaming Internet 
protocol over the computer network. 

Further in a accordance with a preferred embodiment of 
the present invention, the communication system also provides 
buddy functionality whereby communications are sent to user- 
selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the communication system also provides 



buddy functionality whereby communications are sent to user- 
selected buddies via the computer network indicating that a user 
is communicating using a user's telephone via the telephone 
network with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent to user- 
selected buddies via the computer network indicating that a user 
has communicated voice via the telephone network and the com- 
puter network using a user's telephone and a user's voice re- 
sponse computer. Preferably the voice response computers are 
operative to convert DTMF to a buddy communication protocol. 

Moreover in accordance with a preferred embodiment of 
the present invention the multiplicity of voice response comput- 
ers is actuated by the sender choosing an e-mail address of a 
recipient from a pre-defined directory. 

Furthermore in the communication system the multiplici- 
ty of voice response computers are actuated by the sender enter- 
ing an e-mail address of a recipient via DTMF codes. Preferably 
the multiplicity of voice response computers are operative to 
store in a directory, e-mail addresses entered by a sender. 

Additionally in accordance with a preferred embodiment 
of the present invention the multiplicity of voice response 
computers is actuated by the sender entering an e-mail address 
of a recipient via speech recognition by one of the multiplicity 
of voice response computers. 

There is also provided in accordance with a preferred 
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embodiment of the present Invention a voice communication system 
including a telephone network including a multiplicity of tele- 
phones interconnected by telephone network interconnections, a 
computer network having a multiplicity of nodes and enabling non- 
streaming Internet protocol communication between the nodes, a 
multiplicity Of voice response computers, each voice response 
computer being connected to a node of the computer network and 
being actuable by an input received from one of the multiplicity 
of voice response computers via the computer network for receiv- 
ing voice communicated via a non-streaming internet protocol 
over the computer network and providing a voice output to a 
telephone via the telephone network. 

Further in accordance with a preferred embodiment of 
the present invention, the communication system also provides 
buddy functionality whereby communications are sent from user- 
selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent from user- 
selected buddies via the computer network indicating that a user 
is communicating using a user's telephone via the telephone 
network with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent from user- 
selected buddies via the computer network indicating that a user 
has communicated voice via the telephone network and the com- 
puter network using a user's telephone and a user's voice re- 
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sponse computer. 

Further in accordance with a preferred embodiment of 
the present invention the voice response computers are capable of 
sensing the presence of a link to an audio file in e-mail re- 
ceived thereat . 

Preferably the voice response computers are capable of 
sensing the presence of a link to an audio file in e-mail re- 
ceived thereat. Additionally the voice response computers may be 
capable of accessing said audio file via the link for playing 
the audio file to a recipient. 

There is provided in accordance with yet another pre- 
ferred embodiment of the present invention a voice communication 
system including a telephone network including a multiplicity of 
telephones interconnected by telephone network interconnections, 
a computer network having a multiplicity of nodes and enabling e- 
mail communication between the nodes, a multiplicity of voice 
response computers, each voice response computer being connected 
to a node of the computer network and being actuable by an input 
received from one of the multiplicity of telephones via the 
telephone network for communicating voice received via the one 
of the multiplicity of telephones via a non-streaming Internet 
protocol over the computer network, each voice response comput- 
er also being actuable by an input received from one of the 
multiplicity of voice response computers via the computer net- 
work for receiving voice communicated via a non-streaming Inter- 
net protocol over the computer network and providing a voice 
output to a telephone via the telephone network. 
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Further in accordance with a preferred embodiment of 
the present invention, the communication system also provides 
buddy functionality whereby communications are sent to user- 
selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent to user- 
selected buddies via the computer network indicating that a user 
is communicating using a user's telephone via the telephone 
network with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention, the communication system also provides 
buddy functionality whereby communications are sent to user- 
selected buddies via the computer network indicating that a user 
has communicated voice via the telephone network and the com- 
puter network using a user's telephone and a user's voice re- 
sponse computer. 

There is also provided in accordance with a preferred 
embodiment of the present invention a communication system 
including a cellular telephone network including a multiplicity 
of telephones interconnected by telephone network interconnec- 
tions, a computer network having a multiplicity of nodes and 
enabling communication between the nodes, a multiplicity of 
computers, each computer being connected to a node of the com- 
puter network and being actuable by an input received from one of 
the multiplicity of telephones via the telephone network for 
communicating messages received via the one of the multiplicity 
of telephones via a telephone compatible Internet communication 
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language over the computer network, at least one of senders or 
recipients of the messages being user-selected buddies. 

There is provided in a accordance with yet another 
preferred embodiment of the present invention a communication 
system including a cellular telephone network including a multi- 
plicity of telephones interconnected by telephone network inter- 
connections, a computer network having a multiplicity of nodes 
and enabling communication between the nodes, a multiplicity of 
computers, each computer being connected to a node of the com- 
puter network and being actuable by an input received from one of 
the multiplicity of voice response computers via the computer 
network for receiving messages communicated via a telephone 
compatible Internet communication language over the computer 
network and providing a telephone compatible Internet communica- 
tion language output to a telephone via the telephone network, 
at least one of senders or recipients of the messages being 
user-selected buddies. 

There is also provided in accordance with yet a further 
embodiment of the present invention a communication system 
including a cellular telephone network including a multiplicity 
of telephones interconnected by telephone network interconnec- 
tions, a computer network having a multiplicity of nodes and 
enabling communication between the nodes, a multiplicity of 
computers, each computer being connected to a node of the com- 
puter network and being actuable by an input received from one of 
the multiplicity of telephones via the telephone network for 
communicating messages received via the one of the multiplicity 
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of telephones via a telephone compatible Internet communication 
language over the computer network, each computer also being 
actuable by an input received from one of the multiplicity of 
computers via the computer network for receiving messages commu- 
nicated over the computer network and providing a telephone 
compatible Internet communication language output to a telephone 
via the telephone network, at least one of senders or recipi- 
ents of the messages being user-selected buddies. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the present invention a communication 
system for use with a computer network which includes a recorder 
recording a sender's voice, a web server storing the sender's 
voice, and a notifier sending a notification to at least one 
recipient, the notification containing a link enabling retrieval 
of the sender's voice from the web server. 

Further in accordance with a preferred embodiment of 
the present invention, the recorder employs a telephone net- 



work, 



Still further in accordance with a preferred embodiment 
of the present invention the recorder employs a microphone 
outputting to a computer. 

Additionally in accordance with a preferred embodiment 
of the present invention the web server stores the sender's voice 
together with the meta-inf ormation associated therewith in a 
single storage unit. Preferably the recorder spools the sender's 
voice to a local storage facility. 

Additionally or alternatively the communication system 
includes transmitter transmitting a sender's voice. In the commu- 
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nication system the transmitter transmits the sender's voice 
via HTTP PUT to the web server, and also encodes a sender's 
voice in a compressed format. Furthermore the transmitter may 
also spool the sender's voice to an SMTP server. 

The web server may also include an SMTP server, and an 
HTTP server enabled to handle PUT commands. 

Still further in accordance with a preferred embodiment 
of the present invention the web server encodes said sender's 
voice in a streaming format. 

Additionally in accordance with a preferred embodiment 
of the present invention the web server is operative - to encode 
multiple senders' voices simultaneously. The web server may also 
include functionality which associates user preferences with 
recorded user voice elements. 

Moreover in accordance with a preferred embodiment of 
the present invention, the communication system also includes the 
functionality of formatting the notification as a function of at 
least one parameter of the recipient. 

Further in accordance with a preferred embodiment of 
the present invention, the communication system also includes 
the functionality of formatting the notification for a plurality 
of participants as a function of at least one parameter of each 
recipient. 

Still further in accordance with a preferred embodiment 
of the present invention the link connects to at least an adver- 
tising medium. Preferably the link also connects to an audio 



file 
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There Is also provided in accordance with preferred 
embodiment of the present invention a communication system in- 
cluding a telephone network including a multiplicity of tele- 
phones interconnected by telephone network interconnections, a 
computer network having a multiplicity of nodes and enabling 
communication between the nodes, at least one web server con- 
nected to one of the multiplicity of nodes, and at least one 
voice response computer connected to one of the multiplicity of 
nodes, and includes the following: at least one of the multi- 
plicity of telephones communicates data with the at least one 
web server using a telephone compatible Internet communication 
language, at least one of the multiplicity of telephones commu- 
nicates voice with the at least one voice response computer, 
and at least one of the multiplicity of telephones communicates 
identification information to the at least one voice response 
computer, the identification information establishing a connec- 
tion between the voice and the data. 

There is also provided in accordance with yet another 
preferred embodiment of the present invention a communication 
system including a telephone network including a multiplicity of 
telephones interconnected by telephone network interconnections, 
a computer network having a multiplicity of nodes and enabling 
communication between the nodes, at least one web server con- 
nected to one of the multiplicity of nodes, and at least one 
voice response computer connected to one of the multiplicity of 
nodes, and the communication system also includes at least one of 
the multiplicity of telephones communicates data with the at 
least one web server using a telephone compatible Internet commu- 
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nication language, at least one of the multiplicity of tele- 
phones communicates voice with the at least one voice response 
computer, at least one of the multiplicity of telephones commu- 
nicates identification information to the at least one voice 
response computer, the identification information establishing a 
connection between the voice and the data, and the at least 
one voice response computer records the voice received from the 
at least one of the multiplicity of telephones. 

There is provided in accordance with yet another pre- 
ferred embodiment of the present invention a communication system 
including a telephone network including a multiplicity of tele- 
phones interconnected by telephone network interconnections, a 
computer network having a multiplicity of nodes and enabling 
communication between the nodes, at least one web server con- 
nected to one of the multiplicity of nodes, and at least one 
voice response computer connected to one of the multiplicity of 
nodes and wherein at least one of the multiplicity of telephones 
communicates data with the at least one web server using a 
telephone compatible Internet communication language, at least 
one of the multiplicity of telephones communicates voice with 
the at least one voice response computer, and at least one of the 
multiplicity of telephones communicates identification informa- 
tion to the at least one voice response computer, the identifica- 
tion information establishing a connection between the voice and 
the data, the at least one voice response computer records the 
voice received from the at least one of the multiplicity of 
telephones and stores the voice on the web server, and a notifi- 
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cation is sent to at least one recipient, the notification 
containing a link enabling retrieval of the voice from the web 
server . 

There is provided in accordance with yet another pre- 
ferred embodiment of the present invention a communication system 
including a computer network having a multiplicity of nodes and 
enabling e-mail communication between the nodes, and at least 
one database connected to the computer network and storing e- 
mail communications between the nodes. 

Further in accordance with a preferred embodiment of 
the present invention and wherein each of the multiplicity of 
databases contains a plurality of mail tables, wherein each mail 
table has assigned thereto a limited number of users. 

Still further in accordance with a preferred embodiment 
of the present invention at least one of the multiplicity of 
databases includes a list of destination addresses. 

Additionally in accordance with a preferred embodiment 
of the present invention, the list includes a multiplicity of 
lists of destination addresses. Preferably at least one of said 
multiplicity of databases includes a meta-list for indexing the 
multiplicity of lists. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the present invention a method for 
management of electronic mail, including the steps of converting 
an e-mail message from text to speech; receiving an input request 
for a selected e-mail message, reading the selected e-mail mes- 
sage, recording a reply to the selected e-mail message, producing 
an audio file, and sending the audio file as an attachment to a 
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reply e-mail. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a WAV file. Additionally 
or alternatively the audio file is a compressed WAV file. 

Still further in accordance with a preferred embodiment 
of the present invention and also including the step of down- 
loading an e-mail message from an e-mail server. 

Additionally in accordance with a preferred embodiment 
of the present invention, the method also includes the step of 
forwarding the selected e-mail message to a pager. The method may 
also include the step of forwarding the selected e-mail message 
to a fax machine. 

There is also provided in accordance with yet another 
preferred embodiment of the present invention a method for man- 
agement of electronic mail, including the steps of converting an 
e-mail message from text to speech; receiving an input request 
for a selected e-mail message, reading the selected e-mail mes- 
sage, recording a reply to the selected e-mail message, producing 
an audio file, storing the audio file on a computer, and sending 
a reply e-mail containing a link to the audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a RealAudio file. 

Still further in accordance with a preferred embodiment 
of the present invention the method also includes the step of 
downloading an e-mail message from an e-mail server. 

Additionally the method further includes the step of 
forwarding the selected e-mail message to a pager. Additionally 
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or alternatively the method also includes the step of forwarding 
the selected e-mail message to a fax machine* 

There is also provided in accordance with another 
preferred embodiment of the present invention a system for man- 
agement of electronic mail, including a text-to-speech converter 
converting an e-mail message from text to speech, a receiver 
receiving an input request for a selected e-mail message, an 
audio player reading the selected e-mail message, an audio re- 
corder recording a reply to the selected e-mail message, produc- 
ing an audio file, and a transmitter sending the audio file as an 
attachment to a reply e-mail. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a WAV file* Preferably 
the audio file is a compressed WAV file. 

Still further in accordance with a preferred embodiment 
of the present invention, the management system also includes a 
downloader downloading an e-mail message from an e-mail server. 

Further in accordance with a preferred embodiment of 
the present invention, the management system also includes a mail 
forwarder forwarding the selected e-mail message to a pager. 

Additionally or alternatively a mail forwarder for- 
warding the selected e-mail message to a fax machine is also 
included. 

There is thus provided in accordance with a preferred 
embodiment of the present invention a system for management of 
electronic mail, including a text-to-speech converter converting 
an e-mail message from text to speech, a receiver receiving an 
input request for a selected e-mail message, an audio player 
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reading the selected e-mail message, an audio recorder recording 
a reply to the selected e-mail message, producing an audio file, 
a computer storing the audio file, and a transmitter sending a 
reply e-mail containing a link to the audio file. 

Further in accordance with a preferred embodiment of 
the present invention, the audio file is a RealAudio file. 

Still further in accordance with a preferred embodiment 
of the present invention, the management system also includes a 
downloader downloading an e-mail message from an e-mail server. 

Additionally in accordance with a preferred embodiment 
of the present invention and also including - a mail forwarder 
forwarding the selected e-mail message to a pager. Additionally 
or alternatively the management system also includes a mail for- 
warder forwarding the selected e-mail message to a fax machine. 

There is thus provided in accordance with yet another 
preferred embodiment of the present invention a method for manag- 
ing voice electronic mail including the steps of playing by a 
local computer an incoming audio file containing a voice message, 
the incoming audio file residing on a remote computer, and saving 
the incoming audio file as a local audio file on the local com- 
puter after the playing step. 

Further in accordance with a preferred embodiment of 
the present invention, the incoming audio file is a streaming 
audio file. 

Still further in accordance with a preferred embodiment 
of the present invention the streaming audio file is a RealAudio 
file. 
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Preferably the local audio file is a WAV file. Addi- 
tionally or alternatively the local audio file is a compressed 
WAV file. 

Still further in accordance with a preferred embodiment 
of the present invention the local audio file is a RealAudio 
file. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the present invention a method for 
management of electronic mail, including the steps of converting 
an e-mail message from text to speech, receiving an input request 
for a selected e-mail message, reading the selected e-mail mes- 
sage, recording a reply to the selected e-mail message, producing 
an audio file, sending the audio file as an attachment to a reply 
e-mail, and playing the audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a WAV file. Preferably 
the audio file is a compressed WAV file. 

Additionally in accordance with a preferred embodiment 
of the present invention the playing step includes the step of 
decompressing the audio file. 

There is also provided in accordance with yet another 
preferred embodiment of the present invention a method for 
management of electronic mail, including the steps of converting 
an e-mail message from text to speech, receiving an input request 
for a selected e-mail message, reading the selected e-mail mes- 
sage, recording a reply to the selected e-mail message, producing 
an audio file, storing the audio file on a first computer, send- 
ing a reply e-mail containing a link to the audio file, playing 
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the audio file, and saving the audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a RealAudio file* 

Still further in accordance with a preferred embodiment 
of the present invention the saving step includes the step of 
converting the audio file to a designated file format. Preferably 
the designated file format is a WAV format. 

Moreover in accordance with a preferred embodiment of 
the present invention the designated file format is a compressed 
WAV format. 

There is provided in accordance with yet another pre- 
ferred embodiment of the present invention a system for managing 
voice electronic mail including an audio player within a local 
computer playing an incoming audio file containing a voice mes- 
sage, the incoming audio file residing on a remote computer, and 
a data processor saving the incoming audio file as a local audio 
file on the local computer, after the audio player plays the 
incoming audio file. 

Further in accordance with a preferred embodiment of 
the present invention the incoming audio file is a streaming 
audio file. 

Still further in accordance with a preferred embodiment 
of the present invention the streaming audio file is a RealAudio 
file. 

Additionally in accordance with a preferred embodiment 
of the present invention the local audio file is a WAV file. 
Preferably the local audio file is a compressed WAV file. 
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Moreover in accordance with a preferred embodiment: of 
the present invention the local audio file is a RealAudio file. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the present invention a system for 
management of electronic mail, including a text-to-speech con- 
verter converting an e-mail message from text to speech, a re- 
ceiver receiving an input request for a selected e-mail message, 
a first audio player reading the selected e-mail message, an 
audio recorder recording a reply to the selected e-mail message, 
producing an audio file, a transmitter sending the audio file as 
an attachment to a reply e-mail, and a second audio player play- 
ing the audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a WAV file. Preferably 
the audio file is a compressed WAV file. 

Additionally the management system also includes a 
decompressor decompressing the audio file. 

There is also provided in accordance with another 
preferred embodiment of the present invention a system for 
management of electronic mail, including a text-to-speech con- 
verter converting an e-mail message from text to speech, a re- 
ceiver receiving an input request for a selected e-mail message, 
a first audio player reading the selected e-mail message, an 
audio recorder recording a reply to the selected e-mail message, 
producing an audio file, a computer storing the audio file, a 
transmitter sending a reply e-mail containing a link to the audio 
file, a second audio player playing the audio file, and a data 
processor saving the audio file. 
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Further In accordance with a preferred embodiment of 
the present invention the audio file is a RealAudio file. 

Still further in accordance with a preferred embodiment 
of the present invention the data processor converts the audio 
file to a designated file format. Preferably the designated file 
format is a WAV format. Additionally the designated file format 
may be in a compressed WAV format. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the a method for management of elec- 
tronic mail, including the steps of converting an e-mail message 
from text to speech, receiving an input request for a selected e- 
mail message, reading the selected-mail containing a link to the 
audio file, recording a reply to the selected e-mail message, 
producing an audio file containing the recorded reply; sending 
the audio file to a computer, and sending a reply e-mail contain- 
ing a link to the audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a RealAudio file. 

Still further in accordance with a preferred embodiment 
of the present invention and also including the step of download- 
ing an e-mail message from an e-mail server. 

Additionally in accordance with a preferred embodiment 
of the present invention and also including the step of forward- 
ing the selected e-mail message to a pager. Additionally or 
alternatively the step of forwarding the selected e-mail message 
may be forwarding the selected e-mail message to a fax machine. 

There is further provided in accordance with yet anoth- 
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er preferred embodimeni: of the present invention a system for 
management of electronic mail, including a text-to-speech con- 
verter converting an e-mail message from text to speech, a re- 
ceiver receiving an input request for a selected e-mail message, 
an audio player reading the selected e-mail message, an audio 
recorder recording a reply to the selected e-mail message and 
producing an audio file containing the recorded reply, and a 
transmitter sending the audio file to a computer and sending a 
reply e-mail containing a link to the audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a RealAudio file. 

Still further in accordance with a preferred embodiment 
of the present invention and also including a downloader down- 
loading an e-mail message from an e-mail server. 

Additionally in accordance with a preferred embodiment 
of the present invention further including a mail forwarder 
forwarding the selected e-mail message to a pager. 

Moreover the preferred embodiment of the present inven- 
tion may also include a mail forwarder forwarding the selected 
e-mail message to a fax machine. 

There is also provided in accordance with a preferred 
embodiment of the present invention a method for management of 
electronic mail, including the steps of converting an e-mail 
message from text to speech, receiving an input request for a 
selected e-mail message, reading the selected e-mail message, 
recording a reply to the selected e-mail message, producing an 
audio file containing the recorded reply, sending the audio file 
to a computer, sending a reply e-mail containing a link to the 
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audio file, playing the audio file, and saving the audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a RealAudio file. 

Still further in accordance with a preferred embodiment 
of the present invention the saving step includes the step of 
converting the audio file to a designated file format. 

Additionally in accordance with a preferred embodiment 
of the present invention the designated file format is a WAV 
format. Preferably the designated file format is a compressed WAV 
format. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the present invention a system for 
management of electronic mail, including a text-to-speech con- 
verter converting an e-mail message from text to speech, a re- 
ceiver receiving an input request for a selected e-mail message, 
a first audio player reading the selected e-mail message, an 
audio recorder recording a reply to the selected e-mail message, 
and producing an audio file containing the recorded reply, a 
transmitter sending the audio file to a computer and sending a 
reply e-mail containing a link to the audio file, a second audio 
player playing the audio file, and a data processor saving the 
audio file. 

Further in accordance with a preferred embodiment of 
the present invention the audio file is a RealAudio file. 

Still further in accordance with a preferred embodiment 
of the present invention the data processor converts the audio 
file to a designated file format. Preferably the designated file 
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format is a WAV format. Additionally or alternatively the desig- 
nated file format is a compressed WAV format. 

There is thus provided in accordance with a preferred 
embodiment of the present invention a method for voice communica- 
tion including the steps of providing a telephone network includ- 
ing a multiplicity of telephones interconnected by telephone 
network interconnections, providing a computer network having a 
multiplicity of nodes, enabling e-mail communication between the 
nodes, providing a multiplicity of voice response computers, each 
voice response computer being connected to a node of the comput- 
er network, and making each voice response computer actuable by 
an input received from one of the multiplicity of telephones via 
the telephone network for communicating voice received via the 
one of the multiplicity of telephones via e-mail over the 
computer network. 

Further in accordance with a preferred embodiment of 
the present invention the method also includes the step of 
providing buddy functionality whereby communications are sent to 
user-selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention the method further includes the step of 
providing buddy functionality whereby communications are sent to 
user-selected buddies via the computer network indicating that a 
user is communicating using a user's telephone via the telephone 
network with a user's voice response computer. 

Still further in accordance with a preferred embodiment 
of the present invention the method also includes the step of 
providing buddy functionality whereby communications are sent to 
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user-selected buddies via the computer network indicating that a 
user has conununicated voice via the telephone network and the 
computer network using a user ' s telephone and a user ' s voice 
response computer . 

Additionally in accordance with a preferred embodiment 
of the present invention the voice response computers are opera- 
tive to convert DTMF to a buddy communication protocol. 

Moreover in accordance with a preferred embodiment of 
the present invention the voice response computers communicate 
with a database. Preferably the database is an SQL database. 

Further in accordance with a preferred embodiment of 
the present invention the step of actuating at least one of the 
voice response computers by choosing an e-mail address of a 
recipient from a pre-defined directory. Additionally or alterna- 
tively the step of actuating at least one of the voice response 
computers by the entering an e-mail address of a recipient via 
DTMF codes. 

Preferably the step of operating at least one of said 
voice response computers includes storing in a directory, e-mail 
addresses entered by a sender. 

Still further in accordance with a preferred embodiment 
of the present invention the step of actuating at least one of 
the voice response computers by entering an e-mail address of a 
recipient via speech recognition by the at least one of the 
multiplicity of voice response computers. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the present invention a method of 
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voice communication including the steps of providing a telephone 
network including a multiplicity of telephones interconnected by 
telephone network interconnections, providing a computer network 
having a multiplicity of nodes, enabling e-mail communication 
between the nodes, providing a multiplicity of voice response 
computers, each voice response computer being connected to a node 
of the computer network, and making each voice response computer 
actuable by an input received from one of the multiplicity of 
voice response computers via the computer network for receiving 
voice communicated via e-mail over the computer network and 
providing a voice output to a telephone via the telephone net- 
work. 

Further in accordance with a preferred embodiment of 
the present invention, the method also provides buddy functional- 
ity whereby communications are sent from user-selected buddies 
via the computer network. 

Still further in accordance with a preferred' embodiment 
of the present invention the method also provides buddy func- 
tionality whereby communications are sent from user-selected 
buddies via the computer network indicating that a user is 
communicating using a user's telephone via the telephone network 
with a user's voice response computer. 

The method of voice communication also provides buddy 
functionality whereby communications are sent from user-selected 
buddies via the computer network indicating that a user has 
communicated voice via said telephone network and said computer 
network using a user ' s telephone and a user ' s voice response 
computer . 
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still further in accordance with a preferred embodiment 
of the present invention the voice response computers are capa- 
ble of sensing the presence of a link to an audio file in e-mail 
received thereat. 

Additionally in accordance with a preferred embodiment 
of the present invention the voice response computers are capable 
of accessing said audio file via said link for playing said audio 
file to a recipient. 

There is also provided in accordance with yet another 
preferred embodiment of the present invention a method of voice 
communication including the steps of providing, a telephone net- 
work including a multiplicity of telephones interconnected by 
telephone network interconnections, providing a computer network 
having a multiplicity of nodes, enabling e-mail communication 
between the nodes, providing a multiplicity of voice response 
computers, each voice response computer being connected to a node 
of the computer network, making each voice response computer 
actuable by an input received from one of the multiplicity of 
telephones via the telephone network for communicating voice 
received via the one of the multiplicity of telephones via e- 
mail over the computer network, making each voice response 
computer also actuable by an input received from one of the 
multiplicity of voice response computers via the computer net- 
work for receiving voice communicated via e-mail over the 
computer network, and providing a voice output to a telephone via 
the telephone network. 

Further in accordance with a preferred embodiment of 
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the present invention also providing buddy functionality whereby 
communications are sent to user- selected buddies via the comput- 
er network. 

Still further in accordance with a preferred embodiment 
of the present invention, the method also provides buddy func- 
tionality whereby communications are sent to user-selected bud- 
dies via the computer network indicating that a user is communi- 
cating using a user's telephone via the telephone network with a 
user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention and also providing buddy functionality 
whereby communications are sent to user-selected buddies via the 
computer network indicating that a user has communicated voice 
via the telephone network and the computer network using a 
user's telephone and a user's voice response computer. 

There is further provided in accordance with a pre- 
ferred embodiment of the present invention a method of voice 
communication including the steps of providing a telephone net- 
work including a multiplicity of telephones interconnected by 
telephone network interconnections, providing a computer network 
having a multiplicity of nodes, enabling e-mail communication 
between said nodes, connecting a multiplicity of voice response 
computers, each voice response computer to a node of the com- 
puter network, and making actuable at least one of the voice 
response computers by an input received from one of the multi- 
plicity of telephones via the telephone network for communicat- 
ing voice received via the one of the multiplicity of tele- 
phones via a non-streaming Internet protocol over the computer 
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network . 

Further in accordance with a preferred embodiment of 
the present invention, the method also provides buddy function- 
ality whereby communications are sent to user-selected buddies 
via said computer network. 

Still further in accordance with a preferred embodiment 
of the present invention also providing buddy functionality 
whereby communications are sent to user-selected buddies via the 
computer network indicating that a user is communicating using a 
user's telephone via the telephone network with a user's voice 
response computer. 

Still further in accordance with a preferred embodiment 
of the present invention and also providing buddy functionality 
whereby communications are sent to user-selected buddies via the 
computer network indicating that a user has communicated voice 
via the telephone network and the computer network using a 
user's telephone and a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention, the method also includes the step of 
operating the voice response computers to convert DTMF to a 
buddy communication protocol. 

Moreover in accordance with a preferred embodiment of 
the present invention, the method further includes the step of 
actuating the multiplicity of voice response computers is by 
choosing an e-mail address of a recipient from a pre-defined 
directory. 

Further in accordance with a preferred embodiment of 
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the present Invention, the method may also include the step of 
actuating the multiplicity of voice response computers by enter- 
ing an e-mail address of a recipient via DTMF codes. 

Further in accordance with a preferred embodiment of 
the present invention and including the step of operating the 
multiplicity of voice response computers to store in a directory, 
e-mail addresses entered by a sender. 

Furthermore the method of voice communication may also 
include the step of actuating the multiplicity of voice response 
computers by the entering an e-mail address of a recipient via 
speech recognition by one of the multiplicity of voice response 
computers . 

There is also provided in accordance with a preferred 
embodiment of the present invention a method of voice communica- 
tion including the steps of providing a telephone network includ- 
ing a multiplicity of telephones interconnected by telephone 
network interconnections, providing a computer network having a 
multiplicity of nodes, enabling non-streaming Internet protocol 
communication between the nodes, connecting a multiplicity of 
voice response computers, each voice response computer to a node 
of the computer network, and actuating an input received from 
one of the multiplicity of voice response computers via the 
computer network for receiving voice communicated via a non- 
streaming internet protocol over the computer network and pro- 
viding a voice output to a telephone via the telephone network. 

Further in accordance with a preferred embodiment of 
the present invention and also providing buddy functionality 
whereby communications are sent from user- selected buddies via 
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the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the method also provides buddy func- 
tionality whereby communications are sent from user-selected 
buddies via the computer network indicating that a user is 
communicating using a user's telephone via the telephone network 
with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention and also providing buddy functionality 
whereby communications are sent from user-selected buddies via 
the computer network indicating that a user has communicated 
voice via the telephone network and the computer network using 
a user's telephone and a user's voice response computer. 

Moreover in accordance with a preferred embodiment of 
the present invention, the method also includes the step of being 
capable of sensing the presence of a link to an audio file in e- 
mail received thereat by the voice response computers, and 
wherein the voice response computers are also capable of access- 
ing the audio file via the link for playing the audio file to 
a recipient. 

Additionally the voice response computers may also be 
capable of sensing the presence of a link to an audio file in e- 
mail received thereat. 

There is also provided in accordance with a preferred 
embodiment of the present invention a method of voice communica- 
tion including the steps of : providing a telephone network in- 
cluding a multiplicity of telephones interconnected by telephone 
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network interconnections, providing a computer network having a 
multiplicity of nodes, enabling e-mail communication between the 
nodes, connecting at least one voice response computer of a 
multiplicity of voice response computers to a node of the com- 
puter network, and actuating a voice response computer by an 
input received from one of the multiplicity of telephones via 
the telephone network for communicating voice received via the 
one of the multiplicity of telephones via a non-streaming Inter- 
net protocol over said computer network, each voice response 
computer also being actuable by an input received from one of the 
multiplicity of voice response computers via the computer net- 
work for receiving voice communicated via a non-streaming Inter- 
net protocol over the computer network and providing a voice 
output to a telephone via the telephone network. 

Further in accordance with a preferred embodiment of 
the present invention, the method of voice communication also 
includes providing buddy functionality whereby communications^ are 
sent to user-selected buddies via the computer network. 

Still further in accordance with a preferred embodiment 
of the present invention, the method of voice communication also 
includes providing buddy functionality whereby communications are 
sent to user- selected buddies via said computer network indicat- 
ing that a user is communicating using a user's telephone via 
said telephone network with a user's voice response computer. 

Additionally in accordance with a preferred embodiment 
of the present invention and also providing buddy functionality 
whereby communications are sent to user-selected buddies via said 
computer network indicating that a user has communicated voice 
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via said telephone network and said computer network using a 
user's telephone and a user's voice response computer. 

There is also provided in accordance with yet another 
preferred embodiment of the present invention, a method of voice 
communication including the steps of providing a cellular tele- 
phone network including a multiplicity of telephones intercon- 
nected by telephone network interconnections, providing a comput- 
er network having a multiplicity of nodes, enabling communica- 
tion between the nodes, connecting at least one computer of a 
multiplicity of computers, to a node of the computer network, 
and actuating at least one of the computers by an input re- 
ceived from one of the multiplicity of telephones via the 
telephone network for communicating messages received via the 
one of the multiplicity of telephones via a telephone compatible 
Internet communication language over the computer network, at 
least one of senders or recipients of the messages being user- 
selected buddies. 

There is thus provided in accordance with yet another 
preferred embodiment of the present invention a method of voice 
communication including the steps of providing a cellular tele- 
phone network including a multiplicity of telephones intercon- 
nected by telephone network interconnections, providing a comput- 
er network having a multiplicity of nodes, enabling communication 
between the nodes, connecting at least one computer of a multi- 
plicity of computers to a node of the computer network, and 
actuating at least one of the computers by an input received 
from one of the multiplicity of voice response computers via the 
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computer network for receiving messages communicated via a 
telephone compatible Internet communication language over the 
computer network and providing a telephone compatible Internet 
communication language output to a telephone via the telephone 
network, at least one of senders or recipients of the messages 
being user-selected buddies. 

There is further provided in accordance with another 
preferred embodiment of the present invention a, a method of 
voice communication including the steps of a providing a cellular 
telephone network including a multiplicity of telephones inter- 
connected by telephone network interconnections, providing a 
computer network having a multiplicity of nodes , enabling communi- 
cation between the nodes, connecting at least one computer of a 
multiplicity of computers to a node of the computer network, and 
actuating at least one of the computers by an input received 
from one of the multiplicity of telephones via the telephone 
network for communicating messages received via the one of the 
multiplicity of telephones via a telephone compatible Internet 
communication language over the computer network, each computer 
also being actuable by an input received from one of the multi- 
plicity of computers via the computer network for receiving 
messages communicated over the computer network and providing a 
telephone compatible Internet communication language output to a 
telephone via the telephone network, at least one of senders or 
recipients of the messages being user-selected buddies. 

There is also provided in accordance with a preferred 
embodiment of the present invention, a method of voice communi- 
cation for use with a computer network and including the steps of 
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providing a recorder recording a sender's voice, providing a web 
server storing the sender's voice, and providing a notifier 
sending a notification to at least one recipient, the notifica- 
tion containing a link enabling retrieval of the sender's voice 
from the web server. 

Further in accordance with a preferred embodiment of 
the present invention, the method includes the step of employing 
a telephone network in the recorder. 

Still further in accordance with a preferred embodiment 
of the present invention, the method also includes the step of 
employing a microphone outputting to a computer in the recorder. 

Additionally in accordance with a preferred embodiment 
of the present invention, and further including the step of 
storing the sender's voice together with the meta- information 
associated therewith in a single storage unit of the web server. 
Preferably, the method of voice communication also includes the 
step of spooling the sender's voice to a local storage facility 
in the recorder . 

Additionally the method may also include the step of 
transmitting a sender's voice from a transmitter, and preferably 
also including the step of transmitting the sender's voice via 
HTTP PUT to the web server of the transmitter. 

Furthermore the method of voice communication and may 
also include the step of spooling the sender's voice to an SMTP 
server of said transmitter. 

Additionally the method may include the step of encod- 
ing a sender's voice in a compressed format in said transmitter. 
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Moreover in accordance to a preferred embodiment of the 
present invention the step of including an SMTP server in the 
web server . 

Further in accordance with a preferred embodiment of 
the present invention also including the step of including an 
HTTP server enabled to handle PUT commands in said web server. 

Still further in accordance with a preferred embodiment 
of the present invention and including the step of encoding the 
sender's voice in a streaming format in the web server. 

Additionally in accordance with a preferred embodiment 
of the present invention and including the step of operating the 
web server to encode multiple senders' voices simultaneously. 

Further in accordance with a preferred embodiment of 
the present invention and also including the step of including a 
functionality which associates user preferences with recorded 
user voice elements in the web server. 

Moreover in accordance with a preferred embodiment of 
the present invention, the method includes the step of including 
the following functionalities: formatting the notification as a 
function of at least one parameter of the recipient and format- 
ting the notification for a plurality of participants as a func- 
tion of at least one parameter of each recipient. 

Further in accordance with a preferred embodiment of 
the present invention, the method also includes the step of 
connecting said link to at least an advertising medium. 

Still further in accordance with a preferred embodiment 
of the present invention and also including the step of connect- 
ing the link also connects to an audio file. 
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There is further provided in accordance with a pre- 
ferred embodiment of the present invention a method of voice 
communication using a telephone network including a multiplicity 
of telephones interconnected by telephone network interconnec- 
tions, a computer network having a multiplicity of nodes and 
enabling communication between the nodes, at least one web 
server connected to one of the multiplicity of nodes, and at 
least one voice response computer connected to one of the multi- 
plicity of nodes, and including the steps of at least one of the 
multiplicity of telephones communicates data with said at least 
one web server using a telephone compatible. Internet communica- 
tion language, at least one of the multiplicity of telephones 
communicates voice with the at least one voice response comput- 
er, and at least one of the multiplicity of telephones communi- 
cates identification information to the at least one voice 
response computer, the identification information establishing a 
connection between the voice and the data. 

There is also provided in accordance with yet another 
preferred embodiment of the present invention a method of voice 
communication using a telephone network including a multiplicity 
of telephones interconnected by telephone network interconnec- 
tions, a computer network having a multiplicity of nodes and 
enabling communication between the nodes, at least one web 
server connected to one of the multiplicity of nodes, and at 
least one voice response computer connected to one of the multi- 
plicity of nodes, and including the steps of at least one of the 
multiplicity of telephones communicates data with the at least 
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one web server using a telephone compatible Internet communica- 
tion language, at least one of the multiplicity of telephones 
communicates voice with the at least one voice response comput- 
er, at least one of the multiplicity of telephones communicates 
identification information to the at least one voice response 
computer, the identification information establishing a connec- 
tion between the voice and the data, and the at least one 
voice response computer records the voice received from the at 
least one of the multiplicity of telephones. 

There is further provided in accordance with yet anoth- 
er preferred embodiment of the present invention a method of 
voice communication using a telephone network including a multi- 
plicity of telephones interconnected by telephone network inter- 
connections, a computer network having a multiplicity of nodes 
and enabling communication between the nodes, at least one web 
server connected to one of the multiplicity of nodes, and at 
least one voice response computer connected to one of the multi- 
plicity of nodes, and the method including the steps of at least 
one of the multiplicity of telephones communicates data with the 
at least one web server using a telephone compatible Internet 
communication language, at least one of the multiplicity of 
telephones communicates voice with the at least one voice 
response computer, and at least one of the multiplicity of 
telephones communicates identification information to the at 
least one voice response computer, the identification informa- 
tion establishing a connection between the voice and the data, 
the at least one voice response computer records said voice 
received from the at least one of the multiplicity of tele- 
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phones and stores the voice on the web server, and a notifica- 
tion is sent to at least one recipient, the notification con- 
taining a link enabling retrieval of the voice from the web 
server • 

There is further provided in accordance with another 
preferred embodiment of the present invention, a method of voice 
communication including the steps of providing a computer network 
having a multiplicity of nodes, enabling e-mail communication 
between the nodes, connecting at least one database to the 

computer network, and storing e-mail communications between the 
nodes • 

Further in accordance with a preferred embodiment of 
the present invention, a method of voice communication and also 
including the step of connecting at least one voice response 
computer at a node of the computer network, the at least one 
voice response computer being capable of accessing the at least 
one database. 

Still further in accordance with a preferred embodiment 
of the present invention and including the step of interposing at 
least one proxy interposed between the at least one voice re- 
sponse computer and the at least one database. 

Additionally in accordance with a preferred embodiment 
of the present invention, each of the multiplicity of databases 
contains a plurality of mail tables, wherein each mail table has 
assigned thereto a limited number of users. 

Further in accordance with a preferred embodiment of 
the present invention at least one of the multiplicity of data- 
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bases includes a list of destination addresses. 

Moreover in accordance with a preferred embodiment of 
the present invention the list comprises a multiplicity of 
lists of destination addresses. Preferably at least one of the 
multiplicity of databases includes a meta-list for indexing the 
multiplicity of lists. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be more fully understood and 
appreciated from the following detailed description, taken in 
conjunction with the drawings in which: 

Fig. lA is a simplified illustration of a voice re- 
sponse computer used for processing voice electronic mail in a 
preferred embodiment of the present invention; 

Fig. IB is an illustration of the use of a voice re- 
sponse computer for accessing e-mail on an e-mail database; 

Figs. 2A and 2B are simplified illustrations of an e- 
mail management system that posts a recorded message as an audio 
file and posts a reply message as an audio file on an Internet 
web site, in accordance with a preferred embodiment of the 
present invention. Fig. 2A representing the functionality of 
posting a recorded message as an audio file and Fig. 2B repre- 
senting the functionality of posting a reply message as an audio 
file; 

Fig. 3 is a simplified illustration of an e-mail man- 
agement system that sends an audio file attachment to a reply e- 
mail, in accordance with a preferred embodiment of the present 
invention ; 

Fig. 4 is a simplified illustration of how a user can 
route his e-mail to a pager and/or a fax machine, in accordance 
with a preferred embodiment of the present invention; 

Fig. 5 is a simplified illustration of how a user can 
send a reply e-mail to a sender's pager and/or a sender's fax 
machine, in accordance with a preferred embodiment of the present 



44 



m 



Invention; 

Fig. 6 is a simplified illustration of two users dial- 
ing in to a voice response computer operative in accordance with 
a preferred embodiment of the present invention; 

Fig. 7 is a simplified illustration of a queue for 
text-to-speech processing tasks in a preferred embodiment of the 
present invention; 

Fig. 8 is a simplified illustration of initiation of a 
voice e-mail message from a telephone; 

Fig. 9 is a simplified illustration of initiation of a 
voice e-mail message using both a web server and a telephone; 

Fig. 10 is a simplified illustration of initiation of a 
voice e-mail message using a telephone which has a web interface; 

Fig. 11 is a simplified illustration of initiation of 
an e-mail message using a telephone; and 

Fig. 12 is a simplified illustration of data and voice 
communication using a web-enabled telephone in accordance with a 
preferred embodiment of the present invention. 
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DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 

The present specification describes a method and system 
for retrieving e-mail by dialing in from a telephone to a voice 
response unit. The e-mail is converted to speech and read to the 
user over the phone. Various selections can be made by pushing 
the buttons of the telephone, and the user can effectively scroll 
through his e-mail and choose the messages to listen to. 

The present specification also describes a method and 
system for replying to e-mail through a telephone. The reply 
takes one or both of two forms: (1) a text e-mail reply, generat- 
ed from the speech reply by a speech-to-text converter, and (2) 
an audio file that contains a recording of the speech reply 
therewithin. In one preferred embodiment of the present inven- 
tion, the audio file is sent back to the original sender as a 
MIME attachment within a reply e-mail, in a standard audio format 
such as a WAV file. 

When the original sender receives the reply e-mail, he 
can download the WAV file to his local computer and play the file 
to listen to the recorded reply. In another preferred embodiment 
the audio file is posted on an Internet web site in a streaming 
audio format such as REALAUDIO R, and a reply e-mail notification 
is sent to the original sender having an Internet link to the 
audio file therewithin. When the original sender receives the 
reply e-mail, he can click on the link to play the audio file. 
Streaming audio formats enable the user to play an audio file on- 
line, while it is being delivered, rather than have to wait until 
the entire audio file is downloaded. REALAUDIO is a registered 



46 



trademark of Prcgressive Networks. Inc. Information about 
REALAUDIO files Is available on the Internet at http://www.rea- 
1 audio. com. 

Advantages of the latter embodiment are (1) the e-mail 
reply is small in size, since it only contains a link to the 
audio file, rather than the file itself; and (2) the audio file 
is streamed for on-line playing. Advantages of the former embodi- 
ment are (1) the reply e-mail is self-contained, and the user 
does not have to use a web browser to listen to the voice reply; 
and (2) sensitive information is not being broadcast over the 
web. It should be pointed out that from an ergonometric point of 
view, both embodiments have the advantage that e-mail messages 
are being replied to with speech, and the replies are being 
listened to rather than read. 

Dictating e-mail messages into a voice response unit over 
a telephone line is faster and simpler than typing a text mes- 
sage. For users who receive large volumes of e-mail on a daily 
basis, reading through e-mail is both time-consuming, and diffi- 
cult on one-s eyes. Many professionals spend hours daily reading 
and replying to e-mail messages. By listening to e-mail, rather 
than reading it, these professionals can work on other "vision- 
intensive" tasks while they are listening to their e-mail mes- 
sages at the same time. This is analogous to working on a task 
while listening in on a conference call being played on the 
speaker of a telephone. 

To assist in understanding the present invention, two 
simplified example sessions are described hereinbelow: 
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EXAMPLE SESSION I 
A mobile user who wishes to send a message to an anoth- 
er person whose name appears on a predefined list of contacts, 
such as a company directory, dials up to a voice response unit 
(VRU). The VRU responds 1. EMAIL 2. PERSONAL DIRECTORY. 3. COMPA- 
NY DIRECTORY. The user selects 3 and the VRU responds PLEASE 
ENTER THE FIRST THREE LETTERS OF THE CONTACT'S NAME. The user 
enters via the telephone touch pad the first three letters. The 
VRU responds TO SEND AN EMAIL TO <CONTACT> PLEASE PRESS 1. The 
User enters 1. The VRU responds PLEASE RECORD YOUR VOICE AT THE 
TONE, PRESS # WHEN YOU ARE FINISHED. The User records his voice 
and presses # to terminate the recording session. 

The VRU then reads a second menu of options as follows: 

1. ATTACH SPEECH REPLY AS A WAV FILE ATTACHMENT TO E-MAIL REPLY 

2. POST SPEECH REPLY AS A REALAUDIO FILE AND A WAV FILE AND SEND 
NOTIFICATION WITH LINKS. Selecting option 1 instructs the VRU to 
attach the WAV file to an e-mail reply. Selecting option 2 in- 
structs the VRU to (1) convert the WAV file to a REALAUDIO file, 
(2) to post both a WAV file and a REALAUDIO file on an Internet 
web Site, and (3) to send a notification reply e-mail containing 
two links - one link to the WAV file and one link to the REALAU- 
DIO file. 

EXAMPLE SESSION 11 

A mobile user dials in to a voice response unit (VRU) 
by means of a telephone to access his e-mail remotely. The VRU 
reads out a message indicating that the user has e-mail in his 
inbox. Each e-mail item contains a unique identifier, data fields 
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including FROM, RE and DATE, a text body, and one or more attach- 
ments. Each e-mail message is converted from text to speech by a 
text-to-speech converter within the VRU. The VRU reads out a 
first menu of options as follows: 

1. ID: 018, FROM: ANDY, RE:MEETING TOMORROW, DATE:mm/dd/yy 
2. ID:004, FROM:BILL, RE:SUNDAY PICNIC, DATE : mm/dd/yy 3. ID:103, 
FROM:CHARLIE, RE:UPCOMING EXAM, DATE :mm/dd/yy 4. ID:075, 
FROM:DAN, RE:DOCTOR'S APPOINTMENT, DATE : mm/dd/yy 5. <MORE> . 
Option 5, "<MORE>", is used for menus that entail more informa- 
tion than is presented in a single list. By selecting "<MORE>", 
the user requests additional lists of menu items. Corresponding- 
ly, successive lists could have a "<BACK>" option for returning 
to previous lists. 

After listening to a specific e-mail message, the user 
can reply to the message and/or route the message to his fax 
machine or to his pager. For reply purposes, the user speaks into 
his telephone and the VRU records the speech as a WAV file. The 
VRU then reads a second menu of options as follows: 1. ATTACH 
SPEECH REPLY AS A WAV FILE ATTACHMENT TO E-MAIL REPLY 2. POST 
SPEECH REPLY AS A REALAUDIO FILE AND A WAV FILE AND SEND NOTIFI- 
CATION WITH LINKS. Selecting option 1 instructs the VRU to attach 
the WAV file to an e-mail reply. Selecting option 2 instructs the 
VRU to (1) convert the WAV file to a REALAUDIO file, (2) to post 
both a WAV file and a REALAUDIO file on an Internet web site, and 
(3) to send a notification reply e-mail containing two links — 
one link to the WAV file and one link to the REALAUDIO file. 

In this case, the receiver has a choice of whether to 
download the WAV file to his local computer, or to stream it for 
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on-line playing. In an alt:ernat:ive embodiment: of the present: 
invention, a choice between attaching a WAV file in a reply e- 
mail or posting a REALAUDIO file and a WAV file on an Internet 
site can be pre-programmed, thus avoiding the need for the second 
menu of options hereinabove. The pre-programmed choice of attach 
vs. post can be customized for each reply address. 

Similarly, in another alternative embodiment of the 
present invention, when posting his reply on an Internet web 
site, the user can be given the choice of whether to post a WAV 
file or a REALAUDIO file, or both. For routing purposes, the VRU 
reads a third menu of options as follows: 1. FAX E-MAIL TO ME. 2. 
FAX E-MAIL ATTACHMENT(S) TO ME. 3. SEND TEXT ONLY TO MY PAGER. 4. 
<MORE>. Selecting option 1 instructs the VRU to fax e-mail, with- 
out attachments, to the user's fax machine. Selecting option 2 
instructs the VRU to fax the e-mail attachment(s) to ti er's 
fax machine. Selecting option 3 instructs the VRU to the 
text body of the e-mail to the user's pager. 

Reference is now made to Fig. lA, which illustrates a 
voice response computer 100 used for processing voice electronic 
mail in a preferred embodiment of the present invention. Voice 
response computer 100 may include several components, as follows: 
A voice processing board 110 is used for processing incoming and 
outgoing voice messages . An example of such a board is the Dia- 
logic D/21H board for Windows, a description of which is avail- 
able at: http://www.dialogic.com. An e-mail client 120 is used 
for pulling incoming e-mail messages from local or remote e-mail 
servers, and for sending outgoing e-mail messages to local or 
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remote e-mail servers. A text-to-speech converter 130 is used for 
converting text messages into voice messages. 

Use of text-to-speech converter 130 is now described. 
Each e-mail message may be converted from text to speech by means 
of text-to-speech converter 130 (Fig. lA). In a preferred embodi- 
ment, the present invention uses Microsoft's SAPI (Speech Appli- 
cation Programming Interface) version 4.0 toolkit for carrying 
out text-to-speech conversion. SAPI can be used with two well- 
known algorithms for text-to-speech conversion: Whistler, and 
Lernout & Hauspie. Reference information for Microsoft's 
SAPI 4.0 is available on-line via the Internet at Microsoft's 
web site http://www.Microsoft.com/iit/onlinedocs/intro2sapi.html, 
and reference information on Lernout & Hauspie is available on 
the Internet at http://www.lhs.com. Other text-to-speech tool- 
kits, such as the AcuVoice toolkit of Fonix Corp., are available 
and can be used instead of a Microsoft toolkit. Reference infor- 
mation on AcuVoice is available on the Internet at http://acu- 
voice.com. 

Text-to-speech converter 130 (Fig. lA) stores the 
resultant speech data in an audio file, such as a WAV file. WAV 
is a standard file format for audio files. Three common types of 
WAV files are PCM (pulse code modulation audio), which is used on 
compact disks (CDs), (2) mLaw compressed audio, and (3) Interac- 
tive Multimedia Association ADPCM (adaptive differential pulse 
code modulation) compressed audio. 

In a preferred embodiment the present invention uses a 
raw uncompressed audio format such as PCM, with single channel 
audio sampled at 11 KHz with 8 bits per sample. Single channel 
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audio 11 KHz with 8 bits per sample are standard sampling param- 
eters for speech. 

An encoder 140 is used to compress WAV and other audio 
files. Use of encoder 140 is described more fully with reference 
to Fig. 3 below. A speech- to- text converter is used for convert- 
ing voice messages into text messages. Use of speech- to -text 
converter 150 is described more fully with reference to Fig. 5 
below. An e-mail server 160 is used as a local intermediate mail 
server for outgoing mail from voice response computer 100. Use of 
e-mail server 160 is described more fully with reference to Figs. 
2A & 2B below. 

E-mail parser 170 is used for two purposes: (1) ex- 
tracting messages and other fields from e-mail, and (2) breaking 
text into granular units such as sentences for managing threads 
that process text-to-speech tasks. Use of e-mail parser 170 is 
described more fully with reference to Fig. 7 below. An e-mail 
database 180 is used for storing e-mail for users of a voice 
response system. Use of e-mail database 180 is described more 
fully with reference to Figs. lA & IB below. 

It will be appreciated by those skilled in the art upon 
reading the ensuing description that the present invention does 
not require use of all of the abovementioned components. Specifi- 
cally, the first components, voice processing board 110 is re- 
quired. The remaining seven components: e-mail client 120, text- 
to-speech converter 130, encoder 140, speech-to-text converter 
150, e-mail server 160, e-mail parser 170 and e-mail database 180 
are not required, but serve to provide additional functionality 
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and enhancements as described hereinbelow. 

Reference is now made to Fig. IB, which illustrates a 
method for accessing e-mail on an e-mail database using a voice 
response computer. A voice response computer 190 preferably 
includes a database proxy 192, which includes N threads and N 
persistent database connections, which manage these connections. 

The voice response computer 190 also preferably in- 
cludes a user interface 194 having M threads, where M > N. 

When a thread of user interface 194 seeks to query a 
database 196, the query is queued on a queue 198 and the database 
proxy 192 is notified accordingly. The database proxy 192 removes 
the query from queue 198 and assigns it to one of its N threads. 
Should more than N queries be received, they are queued until one 
of the N database proxy threads are available. 

The functionality of Fig. IB is particularly useful 
when M is very large, inasmuch as it is difficult to retain M 
persistent database connections. 

Reference is now made to Figs. 2A and 2B, which are 
simplified illustrations of an e-mail management system that 
posts a recorded message as an audio file and posts a reply 
message as an audio file on an Internet web site, in accordance 
with a preferred embodiment of the present invention. Fig. 2A 
representing the functionality of posting a recorded message as 
an audio file and Fig. 2B representing the functionality of 
posting a reply message as an audio file. 

It is appreciated that Figs. 2A and 2B show essentially 
a single system that has two functionalities. It is appreciated 
that the present invention is not limited to a system having both 
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functionalities but extends as well to systems having only one of 
the two functionalities. 

Reference is now made specifically to Fig. 2A, which 
illustrates a message management system that posts a recorded 
message as an audio file on an Internet web site, in accordance 
with a preferred embodiment of the present invention. 

The user, employing a telephone 200, dials in to the 
voice response computer 100 (Fig. lA) and selects a contact from 
his directory listing 202. The user then records a message into 
the voice response computer 100. The user then informs voice 
response computer 100, by means of the telephone pad, that he 
wishes to convert the recorded message into a streaming audio 
format, such as a REALAUDIO format, and to post it on an Internet 
web server 230. Internet web server 230 preferably contains an 
HTTP server 240, an e-mail server 250 and a REALAUDIO server 260. 

In response to the user's instruction, voice response 
computer 100 sends an outgoing e-mail containing a WAV file 
attachment, to e-mail server 250, using the SMTP protocol. Upon 
receiving the e-mail containing the WAV file attachment, Inter- 
net web server 230 extracts the WAV file. If the user instructed 
voice response computer 100 to post WAV and REALAUDIO files, then 
Internet web server 230 converts the extracted WAV file into a 
REALAUDIO file, by means of REALAUDIO encoder 270 contained 
therewithin, and posts both files (the WAV file and the REALAUDIO 
file) on an Internet web site. 

Internet web server 230 then sends an outgoing notifi- 
cation, typically in the form of an e-mail, to the contact, via 
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the contact's e-mall server 280, using the SMTP protocol. As 
alternative to an e-mail notification, the present invention may 
employ an alternative type of notification, such as a notifica- 
tion which employs POTs telephone voice messaging, a beeper, an 
AOL Interactive Messaging (AIM) client or an ICQ client. For the 
sake of simplicity and conciseness, reference is made hereinbelow 
only to e-mail notifications, notwithstanding that the invention 
is not limited thereto. 

The notification e-mail contains links to the REALAUDIO 
file and to the WAV file. Internet web server 230 is better 
suited for sending the notification e-mail than is voice response 
computer 100, since the Internet web server knows precisely when 
the REALAUDIO file and the WAV are posted and available for 
remote access . 

In order to send the outgoing e-mail containing the WAV 
file attachment from voice response computer 100 to e-mail server 
250, it is only necessary for voice response computer 100 to use 
e-mail client 120 (Fig. lA). However, in a preferred embodiment 
of the present invention, voice response computer 100 also con- 
tains its own local e-mail server 160 (Fig. lA). The outgoing e- 
mail containing the WAV file attachment is sent by voice response 
computer 100 to local e-mail server 160. E-mail server 160 then 
sends the e-mail containing the WAV file to e-mail server 250. 

The advantage of using a local e-mail 160 server within 
voice response computer 100 is the time saving in waiting for an 
acknowledgment from the e-mail server receiving the e-mail, when 
an e-mail client sends e-mail, it must wait for an acknowledgment 
from an e-mail server. When e-mail contains a large attachment, 
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such as a WAV file, there is a significant delay in waiting for 
the acknowledgment, due to bandwidth limitations of transmission 
over the Internet. 

The system of Fig. 2A regularly sends e-mail messages 
with large WAV file attachments, and were the e-mail client 
required to wait for an acknowledgment each time a reply e-mail 
is sent, the latency of the system would be prolonged. When an e- 
mail message is sent to a local e-mail server, an acknowledgment 
is received almost immediately. Thus by sending the e-mail con- 
taining the WAV file attachment to its own local e-mail server 
160 (Fig. lA), voice response computer 100 achieves better 
throughput and performance. 

From the contact's e-mail server 280, the notification 
e-mail is retrieved by an e-mail client on the contact's local 
computer 290, as an incoming e-mail, typically using the POP 
protocol. As described hereinbelow, the e-mail client resident in 
the contact's computer 290 may be an audio e-mail client 300 of 
the present invention. Upon receiving the notification e-mail, 
the contact clicks on a link contained in the notification e-mail 
to access the WAV file or the REALAUDIO file, using the HTTP 
protocol . 

The contact's computer 290 contains a REALAUDIO player 
310 for playing REALAUDIO files, and a WAV player 320 for playing 
WAV files. It may be the case that the contact is also a sub- 
scriber to the system of the present invention, as is the user. 
In this case the contact can also call in to server 280, by means 
of telephone 330, to retrieve his e-mail. 
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For simplicity, it is assumed in Fig. 2A that the con- 
tact's e-mail server 280 also functions as a voice response 
computer similar to voice response computer 100. Otherwise, the 
contact calls in to the contact's voice response computer (not 
shown) that pulls the contact's e-mail from e-mail server 280. In 
a preferred embodiment of the present invention, the contact's 
voice response computer (not shown) has the capability to auto- 
matically download audio files linked to a reply e-mail, and to 
play the audio files to the contact. 

In this embodiment, when a notification e-mail with a 
link to an audio WAV file arrives at the contact's e-mail server 
280, and is thereafter received by the contact's voice response 
computer ( not shown ) , the contact ' s voice response computer 
automatically downloads the WAV file linked to the reply e-mail 
and plays it to the contact when he dials in. 

It can thus be appreciated that the contact who is also 
a subscriber to the system of the present invention does not need 
to download the WAV file from the Internet himself, and can 
listen to the contents of the WAV file simply by dialing in to 
his voice response computer. In a preferred embodiment of the 
present invention, voice response computer 100 contains its own 
e-mail database 180 (Fig. lA) for storing the user's e-mail. E- 
mail database 180 provides a structured directory-type facility 
for storing voice electronic mail. The user can save and organize 
his voice electronic mail into individual "mailboxes, *• for future 
access. 

Reference is now made to Fig. 2B, which illustrates an 
e-mail management system that posts a reply message as an audio 
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file on an Internet web site, in accordance with a preferred 
embodiment of the present invention. Elements in Fig. 2B, which 
are identical to those in Fig. 2A are identified by the same 
reference numerals. 

In the discussion of Figs. 2B - 7 that follows, it is 
being assumed that a "user" receives an e-mail message from a 
"sender, " and generates a speech reply. The term "user" is indic- 
ative of the fact that the user under discussion is a subscriber 
to the system of the present invention. 

There exist two alternative methods for providing e- 
mail to e-mail database 180, namely a pull method and a push 
method. These two methods may operate concurrently. 

According to a first method, which is a pull method, e- 
mail client 120 (Fig. lA) polls e-mail server 210 on a regular 
basis (for example, every ten minutes) to determine the contents 
of the user's current inbox of e-mail, and to synchronize the e- 
mail items in e-mail database 180 of voice response computer 100 
with the e-mail items in server 210. 

Specifically, voice response computer 100 pulls newly 
arrived e-mail that has not yet been downloaded from e-mail 
server 210 and places it in e-mail database 180 and purges from 
e-mails database 180 old e-mail, that has not been stored by the 
user in a mailbox for archiving. As described hereinbelow, e-mail 
database 180 (Fig. lA) may be used to store and control the e- 
mail items in voice response computer 100. 

According to a second method, which is a push method, 
an e-mail server 215, upon receiving an e-mail for a user, in- 
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serts the e-mail directly into e-mail database 180. 

In a preferred embodiment of the present invention^ the 
user dials in to voice response computer 100 from telephone 220 
to retrieve his e-mail from e-mail database 180. By pressing on 
the telephone pad in accordance with menu options read from the 
VRU, as illustrated in Example Session II, the user selects e- 
mail messages to be read to him by voice response computer 100. 

After listening to an e-mail message, the user dictates 
a reply into the telephone, and voice response computer 100 
records the reply. The user then informs voice response computer 
100, by means of the telephone pad, that he wishes to convert the 
recorded reply into a streaming audio format, such as a REALAUDIO 
format, and to post it on an Internet web server 230. Internet 
web server 230 contains an HTTP server 240, an e-mail server 250 
and a REALAUDIO server 260. As described hereinbelow, e-mail 
server 210 and e-mail server 250 may be the same e-mail seirver. 

In response to the user's instruction, voice response 
computer 100 sends an outgoing reply e-mail containing a WAV file 
attachment to e-mail server 250, using the SMTP protocol. Upon 
receiving the reply e-mail containing the WAV file attachment, 
Internet web server 230 extracts the WAV file. If the user in- 
structed voice response computer 100 to post WAV and REALAUDIO 
files, then Internet web server 230 converts the extracted WAV 
file into a REALAUDIO file, by means of REALAUDIO encoder 270 
contained therewithin, and posts both files (the WAV file and the 
REALAUDIO file) on an Internet web site. 

Internet web server 230 then sends an outgoing notifica- 
tion e-mail to the sender, via a sender's e-mail server 280, 
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using the SMTP protocol. The notification e-mail contains links 
to the REALAUDIO file and to the WAV file. Internet web server 
230 is better suited for sending the notification e-mail than is 
voice response computer 100 or e-mail server 210, since Internet 
web server knows precisely when the REALAUDIO file and the WAV 
file are posted and available for remote access. 

In order to send the outgoing reply e-mail containing the 
WAV file attachment from voice response computer 100 to e-mail 
server 250, it is only necessary for voice response computer 100 
to use e-mail client 120 (Fig. lA). However, in a preferred 
embodiment of the present invention, voice response computer 100 
also contains its own local e-mail server 160 (Fig. lA). The 
outgoing reply e-mail containing the WAV file attachment is sent 
by voice response computer 100 to local e-mail server 160. E-mail 
server 160 then sends the reply e-mail containing the WAV file to 
e-mail server 250. 

The advantage of using a local e-mail server 160 within 
voice response computer 100 is the time saving in waiting for an 
acknowledgment from the e-mail server receiving the e-mail. When 
an e-mail client sends e-mail, it must wait for an acknowledgment 
from an e-mail server. When e-mail contains a large attachment, 
such as a WAV file, there is a significant delay in waiting for 
the acknowledgment, due to bandwidth limitations of transmission 
over the Internet. 

The system illustrated in Fig. 2B regularly sends e-mail 
replies with large WAV file attachments, and were the e-mail 
client required to wait for an acknowledgment each time a reply 
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e-ma±l is sent, the latency of the system would be prolonged. 
When an e-mail reply is sent to the local e-mail server 160, an 
acknowledgment is received almost immediately. Thus by sending 
the reply e-mail containing the WAV file attachment to its own 
local e-mail server 160 (Fig. lA), voice response computer 100 
achieves better throughput and performance. 

From the sender's e-mail server 280, the notification e- 
mail is retrieved by an e-mail client on the sender's local 
computer 290, as an incoming e-mail, using the POP protocol. As 
described hereinbelow, the e-mail client resident in the sender's 
computer 290 may be an audio e-mail client 300 of the present 
invention. Upon receiving the notification e-mail, the sender 
clicks on a link contained in the notification e-mail to access 
the WAV file or the REALAUDIO file, using the HTTP protocol. 

The sender's computer 290 contains a REALAUDIO player 310 
for playing REALAUDIO files, and a WAV player 320 for playing WAV 
files. It may be the case that the sender is also a subscriber to 
the system of the present invention, as is the user. In this case 
the sender can also call in to server 280, by means of telephone 
330, to retrieve his e-mail. 

For simplicity, it is assumed in Fig. 2B that the send- 
er's e-mail server 280 also functions as a voice response comput- 
er similar to voice response computer 100. Otherwise, the sender 
calls in to a voice response computer (not shown) that pulls the 
sender's e-mail from e-mail server 280. In a preferred embodiment 
of the present invention, the sender's voice response computer 
(not shown) has the capability to automatically download audio 
files linked to a reply e-mail, and to play the audio files to 
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■the sender. 

In this embodiment, when a notification e-mail with a 
link to an audio WAV file arrives at the sender's e-mail server 
280, and is thereafter received by the sender's voice response 
computer, the sender's voice response computer automatically 
downloads the WAV file linked to the reply e-mail and plays it to 
the sender when he dials in. 

It can thus be appreciated that the sender who is also a 
subscriber to the system of the present invention does not need 
to download the WAV file from the Internet himself, and can 
listen to the contents of the WAV file simply by dialing in to 
his voice response computer. In a preferred embodiment of the 
present invention, voice response computer 100 contains its own 
e-mail database 180 (Fig. lA) for storing the user's e-mail. E- 
mail database 180 provides a structured directory- type facility 
for storing voice electronic mail. The user can save and organize 
his voice electronic mail into individual "mailboxes, " for future 
access. 

E-mail database 180 is updated whenever e-mail client 120 
(Fig. lA) polls e-mail server 210 for the user's e-mail. When new 
e-mail has arrived at e-mail server 210, e-mail client 120 down- 
loads it to voice response computer 100, and adds it to database 
180. When old e-mail is removed from e-mail server 210, voice 
response computer 100 removes its copy of such old e-mail from 
database 180, if the old e-mail has not been stored by the user 
in a mailbox. In this way, database 180 maintains synchronization 
with e-mail server 210. Database 180 can be an SQL database with 
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fields such as sender, subject and date. Voice response computer 
100 can carry out user requests for searches within database 180. 
For example, a user may want to access the e-mail that was sent 
from a designated sender within a designated time period. 

Reference is now made to Fig. 3, which illustrates an 
e-mail management system that sends an audio file attachment to 
an e-mail, such as a reply e-mail, in accordance with a preferred 
embodiment of the present invention. As above, the user dials in 
to voice response computer 100 from telephone 220 and dictates an 
e-mail to a recipient. The e-mail may or may not be a reply e- 
mail and the recipient may or may not be the sender of an e-mail 
to which a reply is being sent. 

In the embodiment depicted in Fig. 3, the user informs 
voice response computer 100 that he desires to convert his re- 
corded message, such as a reply, into an audio file, such as a 
WAV file, and to send it to an e-mail server 280 of a recipi- 
ent, such as the sender, as an attachment to an e-mail, such as a 
reply e-mail. As described hereinabove with reference to Figs. 2A 
& 2B, in a preferred embodiment of the present invention voice 
response system 100 sends the e-mail containing the WAV file 
attachment to its own local e-mail server 160 (Fig. lA), and then 
e-mail server 160 sends it to e-mail server 280. This reduces 
network latency caused by the delay in waiting for an acknowledg- 
ment from a remote e-mail server. 

The recipient's computer 290 pulls the e-mail as an 
incoming message from the recipient's e-mail server 280, typical- 
ly using the POP protocol. By clicking on the reference to the 
WAV file attachment in the e-mail, the recipient can either save 
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the file to his local disk, or play it using WAV player 320, or 
both. In an alternative embodiment of the present invention the 
audio file attached to a e-mail can be compressed as a self- 
extracting compressed file. Self -extracting files contain decom- 
pressors therewithin. 

The recipient of an e-mail message with a self -extracting 
file attached therewithin can click on the reference to the file, 
and the compressed audio file automatically decompresses itself. 
For example, the present invention can attach a zipped WAV file 
to an e-mail. The attachment automatically unzips itself and re- 
generates the WAV file when a recipient clicks on the reference 
to the attachment. It is for the purpose of this alternative 
embodiment that voice response computer 100 contains encoder 140 
(Fig. lA) for compressing audio files. 

Reference is now made to Fig. 4, which illustrates how a 
user can route his e-mail to a pager and/or a fax machine, in 
accordance with a preferred embodiment of the present invention. 
The user can instruct voice response computer 100, from telephone 
220, to route his incoming e-mail message by sending it as a text 
message to his pager 410, or to his fax machine 420, or to both 
pager 410 and fax machine 420. 

If the user elects to route his e-mail to pager 410, 
voice response computer 100 typically sends an outgoing e-mail 
message to e-mail gateway 430, using the SMTP protocol. Gateway 
430 operates by accepting e-mail as input and producing a message 
that can be delivered to a pager as output. Specifically, the 
Simple Messaging System (SMS) protocol is designed as a protocol 
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for transferring text data to a thin wireless data terminal, such 
as a pager. E-mail gateway 430 converts the user's text e-mail 
into a form suitable for wireless transmission to pager 410. 
Alternatively, voice response computer 100 can communicate in the 
SMS protocol directly with pager 410. 

If the user elects to route his e-mail to fax machine 
420, voice response computer 100 typically sends an outgoing e- 
mail message to e-mail gateway 440, using the SMTP protocol. 
Gateway 440 operates by accepting e-mail as input and producing a 
message that can be transmitted to a fax machine as output. As 
such, e-mail gateway 440 converts the user's text e-mail into a 
form suitable for transmission to fax machine 420. Alternatively, 
voice response computer 100 can communicate directly with fax 
machine 420. 

Reference is now made to Fig. 5, which illustrates how a 
user can send an e-mail, such as a reply e-mail, to a pager or a 
fax machine, in accordance with a preferred embodiment of the 
present invention. As described hereinabove with reference to 
Figs. 2a, 2B and 3, the present invention enables the user to 
send an e-mail, such as an e-mail reply, by dictating into a 
telephone. The speech message is recorded, stored as an audio 
file and delivered to the recipient. 

Fig. 5 illustrates the alternative of converting the 
speech message into a text message, and sending the text message 
to the recipient's pager 510, or to the recipient's fax machine 
520, or to both. It is for the purpose of this feature that voice 
response computer 100 contains speech-to-text converter 150 (Fig. 
lA) for producing a text message from speech dictated into the 
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user's telephone 220 (Figs. 2A and 2B). Voice response computer 
100 converts the user's speech reply to a text message, by means 
of speech-to-text converter 150. If the user elects to deliver 
the text message to pager 510, voice response computer 100 typi- 
cally sends the text message as an outgoing e-mail to e-mail 
gateway 530, using the SMTP protocol. 

If the user elects to deliver the text message to fax 
machine 520, voice response computer typically sends the text 
message as an outgoing e-mail to e-mail gateway 540, using the 
SMTP protocol. Although it is the "un-wired" mobile user who 
typically accesses his e-mail through a telephone unit, the 
present invention is also advantageous to the "wired" user who 
accesses his e-mail through a computer connected to a network. 

For reasons of convenience, and other reasons as well, 
a user with a computer may nevertheless prefer to reply to e-mail 
messages and send new e-mail messages using speech rather than 
text. An indicator of this is the emergence of IP phones for 
speech communication over the Internet. 

The present invention also provides an audio e-mail 
client that manages incoming and outgoing audio messages. It 
enables a user to dictate a voice e-mail message by speaking into 
a microphone connected to his computer, and to convert the speech 
into an audio file. The audio file can then be either (1) sent as 
an attachment to a standard e-mail message, or (2) posted on an 
Internet web site. In the latter case, a notification e-mail 
message with a link to the audio file is sent. It can thus be 
appreciated that the present invention provides voice mail-like 
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capability to a computer user. 

The audio e-mail client of the present invention may 
enable a user to save an audio file that is in a streaming audio 
format on a remote server computer or on his local computer. This 
feature is not available in standard REALAUDIO players. Such 
players are used for listening to live broadcasts over the Inter- 
net, such as newscasts, and are typically used to play an audio 
file once. The present invention introduces a novel use of 
streaming audio files; namely, for voice e-mail messages, and in 
this context it is important to be able to save the voice mes- 
sages for future reference. In a preferred embodiment, the audio 
e-mail client of the present invention provides a mail archive 
for voice messages that is structured hierarchically in files and 
directories, as is commonly done today for text e-mail messages 
using familiar e-mail clients such as EUDORA, MICROSOFT INTERNET 
EXPLORER and NETSCAPE COMMUNICATOR. 

When an incoming voice e-mail message is saved, the user 
can direct it to a specific directory or sub-directory, for 
cataloging and indexing purposes. Moreover the incoming voice e- 
mail message can be saved in a variety of formats, such as REA- 
LAUDIO, WAV or compressed WAV. 

Referring back to Fig. 2B, in a preferred embodiment of 
the present invention the sender's computer 290 contains such an 
audio e-mail client 300, to play the REALAUDIO file posted by 
Internet web server 230 and to save the file on Internet web 
server 230 or on the sender's computer 290. A similar structure 
is applicable to a recipient using the functionality of Fig. 2A. 
In a preferred embodiment, the audio e-mail client of the present 
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invention also carries out remote functions by posting voice e- 
mail messages on an Internet web server. 

Specifically, a user can post voice e-mail messages on an 
Internet web site for retrieval by another person, or for pur- 
poses of archiving his own voice e-mail. Audio e-mail client 300 
has the capability to manage RAM, hard diskspace and files on 
remote server computers, by using an appropriate protocol for 
uploading and storing REALAUDIO and other audio files on Internet 
web server 230. This is indicated in Fig. 2B by two-directional 
arrows between Internet web server 230 and audio e-mail client 
300. Similarly, audio e-mail client 300 is used in the embodiment 
illustrated by Fig. 3 for the purpose of file management on 
remote server computers. 

Specifically, audio e-mail client 300 can archive and 
manage the WAV files it receives by storing them on a remote 
server computer such as Internet web server 230 (Figs. 2A & 2B). 
The sender's voice electronic mail is thus stored on a remote 
computer, and accessible from his local computer. This is similar 
to the remote mail storage that Hotmail provides to its subscrib- 
ers for text electronic mail. Reference information on Hotmail is 
available at http://www.hotmail.com. 

In a preferred embodiment of the present invention, 
Internet web server 230 is part of an overall electronic voice 
mail management system. The overall management system also in- 
cludes voice response computer 100 and, optionally, e-mail server 
210. The protocol for uploading and storing files on Internet web 
server 230 may be proprietary, and, if so, audio e-mail client 
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300 sends files and instructions to Internet web server 230 in 

accordance with such proprietary protocol. 

It should be apparent to those skilled in the art that 
various processing units illustrated in the various figures may 
reside in separate computers, or in the same computer. For exam- 
ple, referring to Figs. 2A & 2B, voice response computer 100 and 
e-mail server 210 and Internet web server 230 may all reside 
within the same computer. Referring to Fig. lA, e-mail client 120 
may reside in a different computer than voice response computer 
100, and, as such, need not be contained within voice response 
computer 100. 

The system of the present invention is a multi-user 
system. As such, it should also be apparent to those skilled in 
the art that various processing units depicted in the figures may 
be present multiple times within the system of the present inven- 
tion. For example, referring to Fig. lA, voice response computer 
100 may contain several e-mail clients 120. 

Reference is now made to Fig. 6, which illustrates two 
users dialing in to a voice response computer operative in ac- 
cordance with a preferred embodiment of the present invention. 
The two users are referred to as "user #1" and "user #2." Voice 
response computer 100 pulls e-mail from e-mail server 210 con- 
taining user #l's e-mail, and from a second e-mail server 610 
containing user #2's e-mail. User #1 dials in to voice response 
computer 100 by means of telephone 220, and user #2 dials in by 
means of telephone 620. 

Voice response computer 100 is connected to two e-mail 
clients 630 that work in parallel. Were a single e-mail client to 
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be used, there would be only one client pulling e-mail for user 
#1 and user #2. Voice response computer 100 may also contain 
multiple text-to-speech converters 130 (Fig. lA) and multiple e- 
mail parsers 170 (Fig. lA), for simultaneously handling multiple 
users, rather than processing the user messaging tasks in a 
single queue. For multi-user systems such as the systems of the 
present invention, the management of processing threads is a 
significant factor in overall system performance. 

One of the recurrent processing tasks performed by the 
system of the present invention is the conversion of e-mail 
messages from text to speech by text-to-speech converter 130 
(Fig. lA). Voice response computer 100 routinely processes an 
enormous volume of e-mail messages. Were a separate processing 
thread to be allocated for each text-to-speech task, the prolif- 
eration of threads could choke the system, resulting in poor 
performance. In a preferred embodiment, the present invention 
uses a small number of threads and uses a waiting queue for text- 
to-speech tasks. 

Reference is now made to Fig. 7, which is a simplified 
illustration of a queue for text-to-speech processing tasks in a 
preferred embodiment of the present invention. For simplicity a 
single thread 710 is illustrated. Thread 710 handles each 
text-to-speech task, and carries out a function described as 
D0(t, f), where t is a text string and f is an audio file. The 
function DO converts text string t to speech, and saves the 
result in audio file f, using text-to-speech converter 130. 

Shown in Fig. 7 are two e-mail text messages 720 and 
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730 that have been downloadea to voice response computer 100 by 
e-mail client 120 (Fig. lA). Each e-mail message Is to he proc- 
essed by thread 710, for conversion from text to speech. The 
processing requests for messages 720 and 730 are temporarily 
stored m a waiting, queue 740. As thread 710 completes each tasK, 
a new task is delivered by waiting queue 740. 

one problem encountered by such a thread management 
system is that of "blocking. " Blocking occurs when a task that 
requires a large amount of processing blocks other tasks that 
require little processing. For example, suppose message 720 is a 
large message and message 730 is a short message, and that mes- 
sage 720 is ahead of message 730 in queue 740. Then the text-to- 
speech processing for message 730 would be deferred until message 
720 is completely converted Into speech. 

The present invention overcomes the problem of blocking, 
m a preferred embodiment, by parsing each message Into small 
units, such as individual sentences, by e-mail parser 170. Each 
sentence Is then individually sent to queue 740 for input to 
thread 710 as a separate text-to-speech conversion task. In this 
wey, the short message 730 may enter queue 740 at a queue posi- 
tion between the sentences of message 720, and thus be processed 
by thread 710 before the processing of message 720 Is finished 
E-mail parser 170 may use punctuation marks as a basis for pars- 
ing messages into Individual sentences. 

E-mail parser 170 may include a pre-parsing module 
Which, m a preferred embodiment Of the present Invention is 
implemented as a PERL module. The pre-parsing module may perform 
text substitutions, insertions and deletions which may improve 
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the understandabillty of text to speech conversions* 

It should be apparent to those skilled in the art that 
other methods of parsing may be used instead, and that messages 
may be parsed into units other than sentences as well* For exam- 
ple, for uniformity of size, messages may be parsed into units of 
consecutive words whose total size does not exceed 100 charac- 
ters. It should also be apparent to those skilled in the art that 
multiple e-mail parsers 170 may be present within voice response 
computer 100, in order to process multiple e-mail messages in 
parallel • 

The present invention is also useful within a "buddy 
system." Such a system is based upon a "buddy list," which is a 
list of friends, or members, who wish to be notified when any 
members of the list are on-line. An example of such a system is 
the Mirabilis ICQ ("I seek you") system for notifying the other 
members when a member of the list is connected to the Internet. 
Reference information on the ICQ system is available on the 
Internet at http://www.icq.com. 

Within the context of the present invention, voice re- 
sponse computer 100 can be programmed to notify members of a 
"buddy list" whenever a user who is one of the members dials in 
to his voice response computer. Upon notification the members are 
alerted that the user is currently dialed in to his voice re- 
sponse computer, and, as such, can be contacted therefrom. It 
should be appreciated that the buddy list notification may be 
employed by the user to send a message to a buddy. 

Reference is now made to Fig. 8 which is a simplified 
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±llust:rat:±on of init:iat:ion of a voice e-mail message from a 
telephone in accordance with a preferred embodiment of the 
present invention • As seen in Fig, 8, a person who wishes to send 
a voice e-mail uses a POTS telephone to call a voice response 
unit (VRU)o Once a connection has been made to the VRU, the 
sender may enter an intended recipient's e-mail address either by 
choosing an entry from the pre-defined directory listing, via 
DTMF codes on the POTS telephone or alternatively or additionally 
by speaking via a speech recognition module. 

The sender is typically prompted to record a voice mes- 
sage and does so. The VRU then generates a unique identifier 
(UID) for the voice message and transmits the recorded voice 
message, typically in a WAV format to an event controller o The 
event controller preferably saves the WAV formatted data to a 
file converts it to a REALAUDIO file and sends an e-mail to the 
intended recipient with a link to the REALAUDIO and the WAV 
files. The event controller also preferably inserts an audio file 
listing database information corresponding to the voice message, 
typically including the UID, the particulars of the sender, the 
subject of the voice message and the links to the REALAUDIO and 
WAV files. 

The recipient receives the e-mail, which provides the 
link with the UID, and clicks on the link to receive the voice 
message. The recipient's computer contacts the web server, which 
connects to the audio file listing database and retrieves a link 
to the voice message. The link is employed by the recipient's 
computer to play the voice message. 

Reference is now made to Fig, 9, which is a simplified 
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Illustration of initiation of a voice e-mail message using both a 
web server and a telephone. In the embodiment of Fig. 9, a person 
intending to send a voice message submits a form bearing the 
intended recipient's e-mail address as well as his own e-mail 
address and the subject of the voice message. The form is direct- 
ed to a web server which generates a UID and transmits the UID to 
the sender. The sender then telephones a VRU using a POTS tele- 
phone and enters the UID. The sender is typically prompted to 
record a voice message and does so. The VRU then transmits the 
recorded voice message, typically in a WAV format to an event 
controller. 

The event controller preferably saves the WAV formatted 
data to a file, converts it to a REALAUDIO file and sends an e- 
mail to the intended recipient with a link to the REALAUDIO and 
the WAV files. The event controller also preferably inserts an 
audio file listing database information corresponding to the 
voice message, typically including the UID, the particulars of 
the sender, the subject of the voice message and the links to the 
REALAUDIO and WAV files. 

The recipient receives the e-mail which provides the link 
with the UID and clicks on the link to receive the voice message. 
The recipient • s computer contacts a web server which connects to 
the audio file listing database and retrieves a link to the voice 
message, which link is employed by the recipient's computer to 
play the voice message. 

Reference is now made to Fig. 10 which is a simplified 
illustration of initiation of a voice e-mail message using a 
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telephone having a web interface. In the embodiment of Fig, 10, a 
person intending to send a voice message using a telephone web 
interface, such as an HDML UPLink enabled hand-held device com- 
mercially available from suppliers such as Motorola (see 
http: //www. phone, com ) , submits a form bearing the intended recip- 
ient's e-mail address as well as his own e-mail address and the 
subject of the voice message. 

The form is directed to a web server which generates a 
UID and a telephone compatible Internet communication language 
such as HDML page and transmits the UID hidden in the a tele- 
phone compatible Internet communication language such as HDML 
page to the sender. The sender then initiates a telephone call to 
a VRU, typically by pressing a button on the UPLink device. The 
sender is typically prompted to record a voice message and does 
so. The VRU then transmits the recorded voice message, typically 
in a WAV format to an event controller. 

The event controller preferably saves the WAV formatted 
data to a file, converts it to a REALAUDIO file and sends an e- 
roail to the intended recipient with a link to the REALAUDIO and 
the WAV files. The event controller also preferably inserts an 
audio file listing database information corresponding to the 
voice message, typically including the UID, the particulars of 
the sender, the subject of the voice message and the links to the 
REALAUDIO and WAV files. 

The recipient receives the e-mail which provides the link 
with the UID and clicks on the link to receive the voice message. 
The recipient's computer contacts a web server which connects to 
the audio file listing database and retrieves a link to the voice 
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message, which link is employed by the recipient's computer to 
play the voice message. 

Reference is now made to Fig. 11, which is a simplified 
illustration of a method of sending a message, such as an e-mail 
message, using a telephone having a web interface. A person 
intending to send a message, with or without a voice portion, 
enters an intended recipient's e-mail address using any suitable 
method, such as those described hereinabove with reference to any 
of Figs. 8, 9 and 10. Another method of choosing a recipient is 
to use a telephone compatible Internet communication language 
such as HDML enabled telephone and to choose a buddy contact 
from a buddy list. 

The sender determines the contents of the message, 
which may or may not include voice, by employing a VRU and in- 
structing the VRU to send the message or alternatively by access- 
ing a telephone compatible Internet communication language such 
as HDML page on a web server. 

When a VRU is employed, the VRU inserts into a message 
content database the particulars of the contents as well as the 
UID and the particulars of the sender. If a recorded voice is 
part of the message, the remainder of the procedure may be simi- 
lar to that described hereinabove with respect to any of Figs. 8 
- 10. Otherwise, the VRU may send the e-mail message directly to 
the recipient . 

Alternatively, the web server may send a message to the 
recipient's buddy client using a buddy protocol. 

Reference is now made to Fig. 12, which illustrates 
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communication between a web-enabled telephone and both a web 
server and a voice response computer (VRU), This type of communi- 
cation may be particularly useful in various commercial applica- 
tions wherein internet data communications as well as voice 
communications may be carried out by a user from his web-enabled 
telephone with a commercial entity. The two types of communica- 
tion may be simultaneous and are normally asynchronous* 

In a preferred embodiment of the present invention, a 
user, using an HDML/WML enabled telephone 500, or any other 
telephone capable of telephone compatible Internet communication 
establishes a connection with a web server 502, which is prefera- 
bly similarly enabled. The communication between the telephone 
500 and the web server 502 preferably employs the Wireless Appli- 
cation Protocol (WAP) as well as HTTP and TCP/IP protocols and is 
established via a WAP gateway 504. 

The user transmits, from his HDML/WMLenabled telephone 
500, an identifier to the web server 502. The identifier (PHONE 
ID) is normally associated with telephone 500 and is transmitted 
automatically without requiring user action. Alternatively or 
additionally the web server 502 generates an unique identifier. 
Concurrently, the identifier (UID), whether generated by the 
telephone 500 or the web server 502 is stored in a database 506. 

The user chooses a recipient and notifies the web 
server 502 accordingly. He may indicate the recipient by an input 
entered using his telephone 500, either sua sponte or by select- 
ing a specific recipient from a list presented to him either by 
the telephone 500 or the web server 502 which may access the 
database 506 to retrieve contact information, such as the recipi- 
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ent's e-mail address. 

The web server 502 associates the chosen recipient with 
the identifier (UID) in the database 506. 

The user then establishes voice communication between 
telephone 500 and a voice response computer unit 508. This voice 
communication may be initiated by the user sua sponte or in 
response to a prompt from the web server or, as a further, most 
preferred alternative, automatically by the web server 502 or the 
telephone 500 in response to the chosen recipient. 

The intended recipient of the voice communication may 
be represented by a DID (telephone number) provided by the web 
server 502 (CALLS # ID). 

Additionally or alternatively, the caller ID or the 
DID, transmitted by the telephone 500, may serve as the identifi- 
er of the intended recipient of the voice communication, de- 
scribed above. Where this is not the case, the voice response 
computer unit 508 accesses the database 506 to establish a corre- 
lation between the identity of the intended recipient and the 
identifier, which may be the caller ID and /or DID. 

The user may choose one of a number of activity op- 
tions. Some examples of such activity options are set forth 
hereinbelow : 

The user may record a message (by transmitting his 
voice from telephone 500 to VRU 508) such as an e-mail message, 
which is sent to an audio file server 510 and is encoded thereat. 
The audio file 510 may then send a notification to the intended 
recipient. 
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The user may provide voice activation of an application 
( not shown ) . 

The user may listen to voice messages (not shovm). 

It will be appreciated by persons skilled in the art 
that the present invention is not limited by what has been par- 
ticularly shown and described hereinabove. Rather the present 
invention includes combinations and sub-combinations of the 
various features described hereinabove as well as modifications 
and extensions thereof which would occur to a person skilled in 
the art and which do not fall within the prior art. 
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